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Abstract 



We investigate the set of Nash equihbrium payoffs for two person differential games. 

The main result of the paper is the characterization of the set of Nash equilibrium payoffs 

\^ ' in the terms of nonsmooth analysis. Also we obtain the sufficient conditions for a pair of 

^J ■ continuous function to provide a Nash equihbrium. This result generalizes the method of 

r~| ! system of Hamilton-Jacobi equations. 



1 Introduction 



In this paper we characterize Nash equilibrium payoffs for two person differential games. 
We consider nonzero-sum differential games in the framework of positional strategies first 

^^ ■ suggested by N.N. Krasovskii for zero-sum differential games [T]. The existence of Nash 

^— V , equilibrium was established in works of A.F. Kononenko [2j and A.F. Kleimenov [3j. The 

• I proof is based on punishment strategies technique. This technique permits to characterize 

Q ' the set of Nash equilibrium payoffs [5] , [1] • 

^D . The main result of this paper is the characterization of the set of Nash equilibrium 

payoffs in the terms of nonsmooth analysis. Also we obtain the sufficient conditions for 
a pair of continuous function to provide a Nash equilibrium. This result generalizes the 

^ . method of the systems of Hamilton-Jacobi equations. 



2 Preliminaries 

We consider the following doubly controlled system 

x = f{t,x,u,v), te[to,'do], xGM", n G P, vGQ. (1) 

Here u and v are controls of the player I and the player H respectively. Payoffs are terminal. 
The player I wants to maximize (Ti(x(i?o))i the player H wants to maximize (72(x(t?o))- We 
assume that the sets P and Q are compacts, the function /, ai and (T2 are continuous. 



*The work is supported by RFBR (grant No 09-01-00436-a), Grant of President of Russian Federation (project 
MK-7320. 2010.1), RAS Presidium Program of Fundamental Researches "Mathematical Theory of Control". 
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moreover / is Lipschitz continuous with respect to the phase variable, and satisfies the 
subhnear growth condition with respect to x. 

The use the control design suggested in [3]. This control design follows N.N. Krasovskii 
positional formalization. Feedback strategy of the Player I is a pair of function U = 
{u{t,x,e), /3i{e)). Here u{t,x,e) is a function of position (t,x) G [iO)'*?o] x I^" and pre- 
cision parameter e, /3i(e) is a continuous function of precision parameter. We suppose 
that /3i(e) — ?• 0, e ^ 0. Analogously, the feedback strategy of the Player II is a pair 
V = {v{t,x,£),p2{e)). 

Let a position (t*, x*) be chosen. Step-by-step motion is defined in the following way. We 
suppose that the players choose precision parameters ei and £2 respectively. Let the Player I 
choose the partition of the interval [t* , i^o] ^1 = {'^j }j=o of ^^^ fineness less than si . Suppose 
that the Player II chooses the partition A2 = {ik\'k=i o^ ^^^ fineness less than £2- The 
solution a;[-] of equation ([1]) with initial date x[t^] = x^, such that the control of the Player I is 
equal to ^(rj, x[rj], £1) on [tj, tj+i), and the control of the Player II is equal to v{£,k^x[S,k\i£2) 
on [ik,^k+i) is called a step-by-step motion. Denote it by a;[-, t*,x*; f/, £1, Ai; y, £2; A2]. 
The set of all step- by-step motions from the position (t^= , x^ ) under strategies U and V 
and precision parameters £1 and £2 is denoted by X(t*,x*; {7, £1; T/, £2). The step-by-step 
motions is called consistent if £1 = £2- 

A limit of step-by-motions x[-, t , x , C/, £^, A^; V, £2, Ag] is called constructive motion if 
t^ — > t*, x^ -^ X*, £j^ ^ 0, £2 — )• 0, fc — )• 00. Denote by X(t*, x*; U, V) the set of constructive 
motions. By Arzela-Ascoli theorem the set of constructive motions is nonempty. If the limit 
is taken only by consistent step-by-step motions the limit is called consistent constructive 
motions. Denote the set of consistent constructive motions by X'^(t,,,x*; C/, V). This set is 
nonempty also. 

The following definition of Nash equilibrium is used. 

Definition 1. Let (t=K,x=K) G [toi'^^o] x I^"- The pair of strategies U^ and V^ is said to be 
Nash equilibrium solution at the position (t,,,, x*), if for all strategies U and V the following 
inequalities hold: 

max{ai(x[i9o]) ■ x[] e X{U,x^,U,V^)} <m:m{(Ji{x''[M) ■ x''[] e X%U,x^,U^ ,V^)}. 

max{a2(x[??o]) ■ x[] & X{U,x^,U^ ,V)} <mm{a2{x''[M) ■ x^[] G X=(t„x*, [7^, F^)}. 

The pair of payoff (Ji, J2) determined by a Nash solution is called a Nash equilibrium 
payoff of the game. In the typical case there are many Nash equilibriums with different 
payoffs. The set of all Nash equilibrium payoffs is called a Nash value of the game and is 
denoted by by AA(t*, x*). One can consider multivalued map taking (i*, x*) to the A/'(i*, x*). 

The set A/'(t*,x*) is nonempty under the Isaacs condition [3], [2]. The proof is based 
on the punishment strategy technique. If the Isaacs condition is not fulfilled the Nash 
equilibrium solution exists in the class of mixed strategies or in the class of pair counter- 
strategy/strategy [3]. 

Below we suppose the Isaacs condition holds: for all t G [to, "f^o]) x,s ^ M" 

minmax(s, f{t,x,u,v)) = maxmin(s, f{t,x,u,v)). 
u&P v£Q veQ u^P 

Remark 1. If the Isaacs condition doesn't hold, one can consider the solution in the class 
of mixed strategies. For this purpose we consider doubly controlled system 

x= f{t,x,u,v)iy{dv)id{du), te[to,'d], xeW^, /x G rpm(P), 1/ G rpm(Q). (2) 

Jp Jo 



Here /i is a generalized control of the Player I, i^ is a generalized control of the Player II, 
rpm(P),rpm((5) are sets of regular probabilistic measures on P and Q respectively. We 
endow the sets rpm(P) and rpm((5) with *-weak topology. Obtained topology spaces are 
compacts. It is easy to show that the Isaacs condition is fulfilled for system ([2]). Further 
we will not mention the change from system ([1]) to system ^. 

Consider the zero-sum differential game Fi with dynamic determined by ([1]) and the 
payoff determined by o"i(x(t?o))- We assume that the Player I wants to maximize cri(x('i?o)) 
the interest of the Player II is opposite. There exists the value of the game Fi. Denote it 
by oji . Analogously consider the zero-sum differential game with the dynamics ([T]) and the 
payoff o"2. We assume that the Player II wants to maximize o"2(x('!?o)) while the Player I 
want to minimize it. Denote the value of this game by UJ2- 

3 Main result 

Consider the differential inclusion 

X € -F(t, x) = co{/(t, x,u,v) : u & P,v £ Q}. (3) 

By Sol(t*,x=K) denote the set of solution of ^ with initial data x(t*) = x*. 

Proposition 1. Let the multivalued map T : [toi'^^o] ^ I^*^ ~^ 'P(M^) satisfy the following 
conditions: 

(Nl) T{t,x) C [uJi{t,x),oo) X [uj2{t,x),oo) for all{t,x) G [to,M x R"; 

(N2) T{'do,x) = {{ai{x),a2{x))} for all x e M"; 

(N3) for all (t*,x*) € [toi'^^o] x ^^\ {Ji^J2) G T{t^,x^) there exists a motion 
y(-) G Sol(t*,x*) such that 

(Ji,J2)Gr(t,y(t)), te[t,,^o]. 

Then T{t,x) C J\fit,x) for all {t,x) G [to,i9o] x M". 

This proposition follows from [3, Theorem 1.4]. 

Further we limit our attention to closed multivalues maps. The map T '■ [to, 'do] x M"' — > 
V{M.'^) is called closed if its graph is closed T, i.e. Cl[7^ = T. Here CI denotes the closure 
of graph: 

[C17l(t,x) ^ {(Ji, J2) : 3{(t^:E'=)}r=l C [to,M X M- 3{(z^4)} C M^ : 

Let / be a indexing set. Let multivalued maps T" : [to, ??o] x M" — > V{M?), a G I, satisfy 
conditions (N1)-(N3). Define the map T* : [to,f?o] x M" ^ V{R'^) by the rule T* = CIT, 
where 

nt,x)^[[jT''{t,x) . 

The multivalued map T* is closed has compact images and satisfies conditions (N1)-(N3). 
By T"*" denote the closure of pointwise union of all upper semicontinuous multivalued map 
from [to, -do] x R" to M^ satisfying conditions (N1)-(N3). It follows [3j that T+(t,x) = 
J\f{t,x) for ah (t,x) G [to,i?o] x M". 

Further we formulate condition (N3) in the terms of viability theory and obtain the 
infinitesimal form of this condition. 



Theorem 1. Let the map T : [toi'^^o] x ^"' — ^ P(M^) he closed. Then condition (N3) is 
equivalent to the following one: for all (t*,x^,) G [to;^o] xM", {Ji,J2) S T{t^,x^) there exist 
6 > t^: and y(-) G Sol(t*,x=K) suc/i ^/lai 

(Ji,J2)Gr(t,y(t)), tG[t*,0]. 

Theorem [T] is proved in section [SJ 

In order to obtain the infinitesimal form of condition (N3) we define a derivative of a 
multivalued map. By dist denote the following planar distance between the point (Ji, J2) € 
M^ and the set yl C M^: 

dist[(Ji, J2), A] ^ inf{|Ci - Jil + IC2 - J2I : (Ci,C2) e A}. 

Define the directional derivative of the multivalued map by the rule 

A dist[(Ji, J2),r(t + (5,x + <5u;')] 
Dj7T(t, x; (Ji, J2),tt;) = limmt . 

Theorem 2. Let T : [to,^o] x M" -^ ^(M^) ftg c/osed. T/ien condition (N3) ai i/ie position 
(i*,x*) G [io)f^o] X M" is equivalent to the following one: 

sup inf DHT{t^,x^;{Ji,J2),w)=0. (4) 

(Ji,J2)er(t.,x.)'"^-^(**'^'*) 

Theorem [2] is proved in section [5j 
Introduce the set 

5T(t*,x*; (Ji; J2)) = {u^ : BnTit^, x^; {Ji, J2),w) = 0} . 

Remark 2. Condition @ can be formulated in the following way: 

5T(t*,x*; (Ji; J2)) n J"(t*,a;*) = 0, V(Ji, J2) G T(t*,x*). 

The statement follows from the proof of theorem [2l 

Let us show a sufficient condition for the function (ci, C2) : [to; "^o] x M" — )• M^ to provide 
a Nash equilibrium. Denote 

Hi{t, X, s) = maxmin(s, f{t, x, u, v)), H2{t, x, s) = maxmin(s, f{t, x, u, v)). 

Let (ci,C2) : [to,^o] x M" ^ M^, {t,x) G [to,^o] x M", w £ W^ define a modulus derivative 
at the position (t, x) in the direction w G M" by the rule 

A i;.„;„r \ci{t + 5,x + 6w') - ci{t,x)\ + \c2{t + 5,x + 5w') - C2{t,x)\ 



dabs{ci,C2){t,x;u)) = liminf 



Corollary 1. Suppose that the function (ci,C2) : [toj'^^o] x M" — > M? is continuous, 
(ci('!9o, •))C2('*?0i ■)) = (o'i(-)!<72('))' f'^^ ^o.ch i the function ci is upper viscosity solution 
of the equation 

UC' 

-^+Hi{t,x,Vci) = 0, (5) 

and for all {t, x) G [to, ^0] x M" 

inf dabsici,C2){t,x]w) =0. 

Then for all (t, x) G [toi ^0] x M" the pair of numbers (ci(t, x), C2(t, x)) is a Nash equilibrium 
payoff of the game. 



Corollary [T] follows from the definition of modulus derivative and the property of upper 
solution of equation ([5]) ^: uji{t,x) < Ci{t,x) for all {t,x) G [toi'^^o] x '^^■ 

Let us show that the suggested method is a generalization of the method based on the 
system of Hamilton-Jacobi equations. This method provide a Nash solution in the class of 
continuous strategies ^. 

Proposition 2. Let the function {(pi,ip2) : [ioi'^o] >< I^"" ~^ I^^ ^e dijferentiable, and 
{fii'&or)jV2i^o,-)) = (<7i(-))0"2('))- Suppose that the function {ifi,ip2) satisfies the fol- 
lowing condition: for all positions {t,x) G [toi'^^o] x I^" there exist li" £ P, v"" € Q such that 



max 

ueP 



{V^i{t,x)J{t,x,u,v^)) = (Vv?i(t,a;),/(t,x, «",«")>, (6) 



max(V^2(t,x),/(t,2;,u",r;)> = {Vip2{t,x)J{t,x,u'\v'')) (7) 

^^^I^ + {V^,{t,x),fit,x,u\v^))=0, . = 1,2. (8) 

Then the function (931,932) satisfies the conditions of corollary [Jl 

This proposition is proved in section [5j 

If one can choose the pair {u'^,v"') for each position (t, x) G [to, 'do] x M" and the pair of 
directions si,S2 G M" uniquely, then the Hamiltonians Hi are well defined by the rule 

■Hiit, X, SUS2) = {su fit, x, n", v^)), i = l,2. 

In this case condition ([8]) is equal to the following one: {(pi, (P2) is a solution of the system 

-^ + ni{t,x,V^i,Vip2) = 0, i = l,2. 

4 Example 

Consider the nonzero-sum differential game with the dynamic 

^ " ""' (9) 

y = V, 

t G [0,1], n, u G [—1,1]. Payoffs are determined by the formulas ai{x,y) = —\x — y\, 
a2{x,y) = y. We recall that each player wants to maximize his payoff. 

In order to determine the multivalued map M : [0, 1] x M? -^ 7^(1^^), we determine 
auxiliary multivalued maps 5j : [0, 1] x R^ — )■ ^(M), such that 

5i(t,x*,y*) = {z G M : uji{t,x^,y^) < z < c+(t,x*,y*)}. 

Here 

cfi^^^^y)- sup ai\x+ u{^)d(,,y+ v{^)d^]. 
ueu,v<=v \ -J / 

Obviously, 

N{t,x^,y^) C 5i(t, x*,y*) x S2{t,x^,y^). (10) 

First we determine the map 1S2. The value function of the game r2 is equal to 
'^2(^,3;*,?/*) = y* + (1 — i)- Also, c^(t, x*,y*) = y* + (1 — t). Consequently 

52(t,x*,y^,) = y* + (1 - t). (11) 



Let us determine the set Si. Programmed iteration method [6j yields that 

uJi{t,x^,y^) = -|x* -y*\. 

Moreover 

cf{t,x^,y^) = min{ - |x* - y*| + 2(1 - t),0}. 

We obtain that 

5i(t,x*,y^,) = [wi(t,j;*,y*),Cj^(t,x*,y*)]. (12) 

Now we compute the map AA(i,a;*,y*). The hnearity of right hand of Q and the 
convexity of restrictions on control yield that any control can be substitute by the pair of 
constant controls {u,v) € P x Q. We have that for all (Ji, J2) G Si{t,x^,y^,) x 52(i,a;*,y*) 

D//A/(t,x*,y^,;(Ji, J2),(u, wj) > limmt = \v - 1|. 

Therefore, if DnJ^it, a;*, y*; (Ji, J2),'w) = for the pair w = {u, v), then v = 1. 

First we consider the case ?/=„ > x^. Let (Ji, J2) € A/'(t, x*,?/,,,). There exists a mo- 
tion (x(-),y(-)) e Sol(t,x*,2/*) such that (Ji,J2) G M{6,x{9),y{9)), G [t, 1]. Since 
Di/A/'(i,x*,y*; (Ji, J2),tt;) = only if w = 1, there exists u G [—1,1] such that x(l) = 
X* + tt(l — t), y{l) = y* + (1 — t). Consequently y(l) > x(l). Prom condition (N2) we get 
that 

Ji = ai(x(l), y(l)) = -y(l) + x(l) = -y* - (1 - t) + x* + u(l - t) 

= -y* + X* + (1 - t)(n - 1) < -y* + X* = -|x* - y*|. 

The equality is achieved only if n = 1. Condition (Nl) yields that the the following inclusion 
is fulfilled 

A/'(t,x*,y*) C {(-|x* - y*|,y* + (1 - t))}. 

Substituting value (1, 1) for w in formula for DnJ^it, x*, y*; (— |x* — y*|, y* + (1 — t)),w) we 
claim that for y* > x* 

J\f{t,X:,,y^) = {(-|x* -y*|,y* + (1 -*))}• 

Now let y=K < x*. We shall show that 

J\f{t,x^,y^) = 5i(t,x*,y^,) x 52(t,x^,,y*) = 

- |x* - y^,|,min{ - |x* - y^,| + 2(1 - t),0} x {y^, + (1 - t)}. 

Clearly, conditions (Nl) and (N2) hold for this map. Let 70 be a maximal number of segment 
[0,2] such that — |x* — y^,\ +70(1 — t) < 0. If (Ji, J2) G M{t,x^,y^), then J2 = y* + (1 — t), 
Ji = — |x* — y*| + d{l — t) for some d G [0,70]. Let us prove that there exists a number 
(5 > with the property 

(Ji, J2) GA/'(t + <5,x* + (5n,y* + 5) (13) 

for u = 1 — d. It is sufficient to prove that 

Ji G y* — X* + (5(i, min {y* — x* + (5d + 2(1 — t — 5), O} 

Indeed, y* — x=k + d(l — t) > y* — x* + (^d for 5 < {1 — t). Since d < 70, we obtain that 
Ji = y* — x^ + d{\ — t)<y^—x^ + 5d + 70(1 — t — 5). 
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Also 

y* — X* + (5(i + 7o(l — t — 6) < min{y* — x^ + d6 + 2{1 — t — 6);0}. 

Actually, since 70 < 2, the following inequality is fulfilled 

y* - X* + (5d + 70(1 — t — 6) < y* — X* + (i5 + 2(1 — t — (5). 

Moreover y^ — x^^ + 5d + 70(1 — t — 5) < 5d — jq5 < 0. Thus the condition 

Ji < minjy^, — x* + M + 2(1 — t — (5),0} = y* — x* + (^d + 71(1 - i - 5) 

is valid also. It follows from ()13p that 

DHM(t,x„y,; (Ji, J2), (1 - d, 1)) = 0. 

Since M{t, x*, y,,) coincide with the set Si{t, x*, y*) x S2{t, x*, y*) in this case, we claim that 
the set 7\A(t, x^,,y*) is Nash value of the game at the position (t,x*,y*). 

Let us compare the obtained result with the method based on system of Hamilton- Jacobi 
equations [5j . In considered case the system of equations is given by 



— + —u(t,x,y) + —v{t,x,y) =0 
Here the values u{t,x,y) and v{t,x,y) are determined by the following conditions 



(14) 



dipi{t,x,y) 
dx 



u(t,x, y) = max 
ueP 



dLpi{t,x ,y) 
dx 



-u 



dip2it,x,y) 
dy 



v{t,x,y) = max 
■ueQ 



dif2{t,x,y) 
dy 



It follows from Proposition [2] that if a pair of functions (c/^i, Lp2) is a solution of the system 
(fH|l . then ip2{t,x,y) = y + {1 — t). Thus f*(t,x,y) = 1. Consequently, the system ^ 
reduces to the equation 



d(pi 
dt 



+ 



dipi 



dx 



+ 



di£]_ 
dy 



0. 



(15) 



By [71 Theorem 5.6] we obtain that the function 

fi{t,x,y) = 



x-y, x<y, 

-x + y + 2(l-t), X >y, -x + 2/ + 2(l -i) < 0, 

0, x>y,-x + y + 2(l-t) >0 



is a minimax solution of equation ()15p . Indeed if (fi is smooth at (t, x, y) then equation ()15p 
is fulfilled in classical sense. On a planes {(t, x,y) : x = y}, {(t,x,2/) : — x + y + 2(l — t) = 0} 
we have that the Clarke subdifferential is the convex hull of two limit of partial derivatives 
of the function ipi. By well-known properties of subdifferentials and superdifferentail, the 
continuity and positive homogeneity of equation (|15p we obtain that ipi satisfies conditions 
U4 and L4 of [7]. 

The function (pi is nonsmooth. Since the minimax solution is unique, and any classical 
solution is minimax, we claim that system (|14p have no classical solution. One may obtain 
from the formulae for 7V(t, x, y) that (9?i(t, x, y), ^2{t, x, y)) € A/'(t, x, y). Moreover, 

(pi{t,x,y) =max|ji G M : 3 J2 € M (Ji, J2) e7V(t,x,y)|, 
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{ip2{t,x,y)} = {jieR:3J2 (Ji,J2) GM{t,x,y)y 

In other words, the value {<pi{t, x, y), ip2{t, x, y)) is the maximal Nash equilibrium payoff 
of the game at the position (i, x, y). 

One can check that the pair of functions {^pi,ip2) satisfies the conditions of corollary 
[TJ Simultaneity, there exists a family of function satisfying the condition of corollary [TJ 
Actually, if 7 G [0, 2], then put 

~, , ,1 1^* y*\i y* ^ Xif] 

c^{t,Xjf,y^) = < . r I I /-I \ r>T 

[ mm| - |x* - y*| +7(1 - t);0|, y* < x* 

c^{t,x^.,y^) = y* + (1 -t). 

Let us show that the pair of functions {cl,C2) satisfy the conditions of corollary [TJ We have 
that in our case 

lll[t, X,y, Sx, Sy) — \Sx\ \^y\? -^12(1^, X,y, Sx, Sy) — \^y\ \Sx\- 

First we prove that the functions c] are the upper solution of equations ([S]). By [3 condition 
U4] it suffices to show that for all {t,x,y) G [toi'^^o] ^ ^'^ {(i,Sx,Sy) G D~cJ{t,x,y) the 
following inequalities holds 

a + Hi{sx,Sy)<0, i = l,2. (16) 

Here D^ denotes the subdifferential [7, (6.10)]. The computing of sub differentials gives that 



D cl{t,x,y) = < 



{(0,-1,1)}, y>x, 

{(0,0,0)}, y<x<y + j{l-t), 

{(-7,-1,1)}, x>y + ^il-t), 

{(0,A,-A):Ag[0,1]}, x = y, 

{(-A7, -A, A) : A G [0, 1]}, X = y + 7(1 - i). 

D-c2{t,x,y) = {{-1,0,1)}. 



Substituting the values of subdifferentials, we get that p6j) is valid for z = 1, 2. 
Also Cj(l,x*,y*) = (Ti{x^,y^). Moreover, dafes(c]', C2)(t,x*,y*; 1 - d, 1) = for 

[0, y* > x*; 

1 max<^ r G [0,7] : — |x* - y*| + r(l — t) < OJ-, y* < x^,. 

Note that (931,992) = {c\,c\). 

5 Weak invar iance of the set of values 

In this section the statements formulated in section [3] are proved. 

Proof of TheoremU^ If condition (N3) holds, then one can put 9 = i?o- 

Now suppose that for all (t*, x*), ( Ji, J2) G T(t*, x*) there exist 6 G [t*, "i^o] and a motion 
y(-) G Sol(i*,x*), such that the following condition is fulfilled 

(Ji,J2)er(t,y(t)), te[u,0]. (17) 




Let be a set of moments 9 satisfying condition p!7|) for some y(-) € Sol(t*, x*). Denote 
r = supG. We have that t ^ Q. Indeed, let a sequence {9k}'^=i C tend to r. One can 
assume that 9^ < 9^+1 < t. For every k condition pTj) is vahd under 9 = 9^, y{-) = 
yk{-) G Sol(t*,x*). The compactness of bundle of motions yields that yk{-) — > y*(')> k ^ oo, 
here y*(-) is an element of Sol(t*,x*). The closeness of the map T gives that (Ji, J2) € 
T{9k,y*{9k))- By the same argument we claim that (Ji, J2) G T{T^y*{T)). Denote x* = 

Let us show that r = t?o- If t" < f?0) then there exist a motion y(-) G Sol(r, x*) and a 
moment 9' > t such that (Ji, J2) G T(t,y{t)), t G [t, 0']. Consider a motion 

By definition of 9' it follows that 1^3) is valid under 9 = 9' , y{-) = y{-). Thus 6^' G 9, this 
contradicts with the choice of r. Consequently, r = i^o and condition (N3) holds. 

Proof of theorem \^ Let us introduce a graph of map T 

grr={(t,x, Ji, J2) : (t,x) G [to,^o] x M", (Ji, J2) G r(t,x)}. 

One can reformulate the condition of theorem [1] in the following way: the graph of T is 
weakly invariant under the differential inclusion 



: u G P, u G Q > . 



The condition of weak invariance of the multivalued map T under differential inclusion T 
is equivalent [71 [8] to the following condition 

A(grr)(t,x,Ji,J2)n^(t,x)/0 (18) 

for all {t,x) G [ioi^o] x '^^■, {Ji-, J2) G T{t,x). Here Df denotes right-hand derivative in t. 
Let g C [to,'&o] X M™, g[t] denote a section of G by t: 

e[i] = {ty GM™:(t,x)Ge}, 
symbol d denote Euclidian distance between a point and a set. Following [7], [S] put 

(A^)(t,y) ^ (/^ G M™ : liminf ^(^ + ^^;^[^ + ^]^ = 

Let us show that conditions ([ID and ([TSj) are equivalent. 

Condition ([3|) means that for every pair (Ji, J2) G T{t,x) the following condition holds: 

dist[(Ji,J2),r(t + <5,x + 5(u; + 7))] ^ 
mt limmi = L). 

w£T(t,x)5iO,'yeR",\\'y\\iO 

The lower boundary by w in the formula 

^. . ^ dist[(Ji,J2),r(i + 5,x + 5(?i; + 7))] 
mi lim mt ^^ 

weT{t,x)5io,jeR",\\-fUo 
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is attained for all (Ji, J2) G T{t,x). Indeed, let {w^}^i be a minimizing sequence. By the 
compactness of J^{t,x) one can assume that w^ -^ w* , r ^ 00, w* £ T{t,x). Let us show 
that 



b = inf liminf 

wGT(t,x) (5J,0,7eIR",||7|j4.0 



dist [(Ji, J2), T{t + 6,x + 6{w + 7))] 



li^ij^f dist[{Ji,J2),nt + 6,x + 6{w*+^))] 

(5iO,7GM",||7|j4,0 S 

Indeed for every r € N there exist a sequences {(5''''^}^i, {Y'^^JkLi ^^^^ ^^^^ ^^'^ ■> IIt'"''^!! ~^ C), 
A; — )• cxD and 



6'' = liminf 

<5iO,7eM",||7||4.0 



dist [( Ji , J2) , r(t + (5, t + (^(u;^ + 7))] 



lim 



dist [( Ji, J2), r(t + ^"^^ t + ,5"'^(z/;" + 7^^'^))] 



Let A;(r) be a number such that 

<:r,k{r) \\ r,k{r) 
^ 1 W I 



dist [( Ji , J2) , r(t + 5'-'^(") , i + ,5'^' ^('^)(zi;^ + 7^-fcW))] _ ^^^, 



5''.fc('') 



Put (5'^ = 5''^(''\ 7'^ = 7''^(^) + ii;^ - ti;*. Note that (5^ ||7'^|| ^ 0, r ^ 00. 
We have that 



<2~\ 



inf lim inf 

w&T(t,x) <54,0,7gIR",||7||^0 



dist [( Ji, J2), r(t + 5, X + (5(u; + 7))] 



< lim inf 

54.0,7GM",|l7||4-0 



dist [( Ji , J2), r(t + (5, X + 5(u;* + 7))] 



< ^.^ dist[(Jl,J2),r(t + ^^x + ^-K + r))] ^^o) 



Further, 

dist [( Ji, J2), r(t + <5^ X + (5^(ti;* + r))] 



dist[(Ji, J2),r(t + (^''^(^'^x + (5'^'^W(?i;* + 7*^'^^ + w'' - w*))] 
_ dist[(Ji, J2),T{t + 5'''^W,x + 5'-'^W(w'= + 7'^'^W))] 



^n^C*-) 



< fe"^ + 2"'' ^ 6, r ^ 00. 



We have that in (|20p right and left hands are equal. This means that condition (|19p is valid. 
Thus, condition (jl]) is equivalent to the following one: for all (Ji, J2) G T{t,x) there 
exists w G J^(t, x) such that 



lim inf 

54,0,7GK",||7||4,0 



dist [( Ji , J2) , r(t + (5, X + <5(u; + 7))] 



liminf inf<J^^^^^^^^^:(Ci,C2)Gr(t + <5,x + 5(u; + 7))|>=0. (21) 
5;0,7eM",||7||40 1 6 v^ > ^ y v > /// f 
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Now let us prove that this condition is equivalent to condition (jlSp . 
First we assume that condition (jlSp is valid. This means that there exist sequences 
{5*^}^i C M, {7^}^i C M", {e?}£i, {e2}^i C M such that 

• 5'^, ||7^||,ei,e2 — > 0, A; ^- cxo; 

• (t + 5^,x + 5^{w + -f^),Ji+5^e\,J2 + 5^ei\ e grT. 
One can reformulate the second condition as 

(Ji + d'^e'l, J2 + 5hl) G T{t + 5\t + 5\w + 7^=)). 

Thus, 

inf {^^-^^^^^-^ : (Ci,C2) €r(t + <5^x + <5(^ + 7'^))} =e? + 4 

By the choice {ei}, {^q} ^^ obtain that condition ()2ip holds. 

Now let condition ^ be fulfilled, prove that <^ is vahd. Indeed, let {<5''}^i, {7)^1 
be a minimizing sequence. By compactness of the sets T{t + S'^ ,x + 5^{w + 7'')) for each k 
there exist e\ and £2 such that 

(Ji + 5h\, J2 + 6hl) G r(t, X + (5'=(ti; + 7^=)). 

It follows from (f2T]l that £1,62 — > 0, /c ^> cxj. Let us estimate 

df (t/; + 5^w, Ji, J2), grT[t + 5^]] . We have that 



't + 6\x + 5\w + 7'=), Ji + 6^e\, J2 + S''e^2) G E^T. 
Consequently, 



d((^ + S'^w, Ji, J2), grr[t + 5^1) < d'^^JW-f'^W^ + (e^)2 + (e^)2. 

The convergence J'^, ||7'^||,e^,e2 — > as fc — t- 00 yields the equality 

w \ 

G A(grr)(t,x,Ji,J2). 

/ 

Since ^{t,x) =Fx {(0,0)}, we claim that dH]) is fulfilled. 

Proof of Proposition \^ It follows from ([6]) and the Isaacs condition that 

(V(/Ji(t, x), /(t, x,u", v")) > maxmin (V(/3i(t, x), f(t,x,u,v)) = Hi(t,x, V(pi(t,x)). 
^ ' ueP veQ ^ ' 

Analogously, it follows from ([7]) and the Isaacs condition that 

(y(p2{t,x),f{t,x,u'^,v"')) > maxmm(V(f2it,x),f{t,x,u,v)) = H2{t,x,V(f2{t,x)). 

vdQ ueP 

Therefore, using ([8]) we claim that 

dip^t^x) _^H,{t,x,V^i{t,x)) <0, i = l,2. 
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Since the function ipi is differentiable, its subdifferential at the position (t, x) is equal to 
{d^i{t^x)/dt^Vipi{t,x)}. Consequently, the function (pi is the upper solution of equation 
([5]) for i = 1 [3 Condition (U4)]. Analogously, the function c^2 is the upper solution of 
equation ([5]) for i = 2. 

Now let us show that dabs{'^i-,V2){t-,x;w) = for w S T{t,x). Put w = /(t,x,n",t;"). 
Indeed, 

dabs{vi,^2)it,x;w) 

.. .r \(piit + 5,x + d{w + 'y)) -ipi{t,x)\ + \ip2{t + 5,x + 6{w + 'y))-ip2{t,x)\ 
= limmi . 

<5i0,||7||-^0 

Let {S''}'^i C M, {7'^}^;^ C M" be a minimizing sequence. Then 

dabsi^l,V'2)it,X]'w) 



lim 

fc— >oo 



lim -77 

fc-5>00 0'' 






dt 



+ 



^^^('^'^h' + {VMt,x),6\w + j'')) + o{6'^) 



dt 



dipi{t,x) 



dt 



+ {Vipi{t,x),'w) 



+ 



d(f2{t,x) 



dt 



+ {Vip2{t,x),'w) 



By choice of w = /(t,x,n",t;") and condition ([8]) we have that 



dt 

Thus dabsivi,<f2)it,x;w) = 0. 



d(pi{t,x) d<f2{t,x) 

+ {Vipi{t,x),w) = h {V(p2{t,x),w) = 0. 



dt 
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